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Abstract 

We study dynamical systems composed of a set of coupled quadratic 
maps which, if uncoupled, would be on the Feigenbaum accumulation 
point. 

For two units we prove the existence of an infinite number of sinks 
for an open set of coupling parameters. In the limit of many units a 
mean field analysis also implies the stabilization in periodic orbits of, 
at least, a subset of the coupled units. 

Possible applications in the fields of control of chaos, signal pro- 
cessing through complex dynamics and as models of self-organization, 
are discussed. 
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1 Introduction 



In this paper we study dynamical systems composed of a set of coupled 
quadratic maps 

Xi{t + i) = i- fi4J2 (1) 

with X e [-1, 1], Ej Wij = 1 Vz and Wij > Vz, j and = 1.401155.... The 
value chosen for imphes that, in the uncoupled limit {Wu = I, Wij = 
i 7^ j), each unit transforms as a one-dimensional quadratic map in the 
accumulation point of the Feigenbaum period-doubling bifurcation cascade. 
The coupling constants Wij resembling the synaptic connections of a neural 
network, we call this system a Feigenbaum network. The system (|l]) has a 
rich dynamical behavior and coupled systems of this type have been used in 
the past to model the dynamics of interacting populations ||l| g]. 

The quadratic map at the Feigenbaum accumulation point is not in the 
class of chaotic systems (in the sense of having positive Lyapunov exponents) 
however, it shares with them the property of having an infinite number of 
unstable periodic orbits. Therefore, before the interaction sets in, each ele- 
mentary map possesses an infinite diversity of potential dynamical behaviors. 
As we will show later, the interaction between the individual units is able 
to selectively stabilize some of the previously unstable periodic orbits. The 
selection of the periodic orbits that are stabilized depends both on the ini- 
tial conditions and on the intensity of the interaction coefficients Wij. As 
a result Feigenbaum networks appear as systems with potential applications 
in the fields of control of chaos, information processing and as models of 
self-organization. 

Control of chaos or of the transition to chaos has been, in recent years, 
a very active field (see for example Ref. 0] and references therein). Several 
methods were developed to control the unstable periodic orbits that are em- 
bedded within a chaotic attractor. Having a way to select and stabilize at 
will these orbits we would have a device with infinite storage capacity (or infi- 
nite pattern discrimination capacity). However, an even better control might 
be achieved if, instead of an infinite number of unstable periodic orbits, the 
system possesses an infinite number of periodic attractors. The basins of 
attraction would evidently be small but the situation is in principle more 
favorable because the control need not be as sharp as before. As long as the 
system is kept in a neighborhood of an attractor the uncontrolled dynamics 
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itself stabilizes the orbit. 

The creation of systems with infinitely many sinks near an homoclinic 
tangency was discovered by NewhouseQ and later studied by several other 
authors 10 Bl 0- In the Newhouse phenomenon infinitely many at trac- 
tors may coexist but only for special parameter values, namely for a residual 
subset of an interval. Another system, different from the Newhouse phenom- 
ena, which also displays many coexisting periodic attractors is a rotor map 
with a small amount of dissipation |1T0[ . 



In Sect. 2 we prove that with only two units and symmetrical couplings 
one obtains a system which has an infinite number of sinks for an open set 
of coupling parameters. The mechanism by which an infinite number of 
unstable periodic orbits is stabilized by the coupling of two units depends 
strongly on the properties of the maps at the Feigenbaum accumulation point. 
A similar mechanism would not operate, for example, in the tent map. The 
mechanism by which stable periodic orbits might be obtained in piecewise 
linear maps is quite different, as discussed in the last Section of the paper. 

Then, in Sect. 3, we analyze the behavior of a Feigenbaum network in the 
limit of a very large number of units. Using a mean field analysis we show how 
the interaction between the units generates distinct periodic orbit patterns 
throughout the network. The framework and motivation for studying chaotic 
(or chaotic-like) networks for signal processing and pattern recognition is 
then discussed, a simple example being presented in the Feigenbaum network 
setting. Finally, in Sect. 4, we add a few conclusions and discuss some other 
systems, with similar behavior, which might be useful for practical designing 
purposes. 

2 A simple system with an infinite number 
of sinks 

Here we consider two units with symmetrical positive couplings {Wu = 

W21=C> 0) 



Xi{t + 1) = 1 - ((1 - c)xi(t) + CX2(t))^ 



(2) 



X2it + 1) = 1 - /i, (cXi(t) + (1 - C)x2(t)) 

The mechanism leading to the emergence of periodic attractors from a 
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system that, without couphng, has no stable finite-period orbits is the per- 
manence of the unstabihzed orbits in a fiip bifurcation and the contraction 
effect introduced by the couphng. The structure of the basins of attraction 
is also understood from the same mechanism. The result is: 

Theorem: For sufficiently small c there is an N such that the system 
^ has stable periodic orbits of all periods 2" for n > N . 

Proof: 

The bifurcations leading to the Feigenbaum accumulation point at /i* 
are fiip bifurcations. This means that, after each bifurcation, the orbit that 
looses stability remains as an unstable periodic orbit. Therefore, (for c = 0) 
at ;U = /i* the system has an infinite number of unstable periodic orbits 
of all periods p = 2". 

The proof has two basic steps. First we need to prove that, for sufficiently 
small c 7^ 0, these periodic orbits still exist in the system (|^). Second, that 
for any such c, there is an such that there is at least one stable orbit for 
all periods p = 2" with n > N . For both steps an important role is played 
by the instability factor, given by /'■P-' [xp) at the fixed points Xp of the 
j9— iterated map. Therefore we will first find the behavior of this derivative 
for the periodic unstable orbits a.t fi = fi^ and c = 0. 

Iterating once the Feigenbaum-Cvitanovic functional equation 

-^/o/(-Ax)=/(x) (3) 
and taking derivatives one concludes 

f'''(-)=f'{^) (4) 

Because A = 0.3995... is the scaling factor that controls distances, if, for 
example, x* is the fixed point of f^^^ closest to zero, the corresponding fixed 
point for f^^^^ will be at x*X^. Eq.(^) means that for the scaling function 
/, solution of the functional equation, the instability factor for all unstable 
periodic orbits is the same at = /i^,. The logistic function is not a solution 
of the functional equation, however it shares the scaling properties of this 

solution at = Therefore the instability factor (/^^^^ (x*) of the orbits 
at will also converge to a fixed value. Numerically one finds this value to 
be around —1.6. The exact value is not important however, because what 
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matters for our result is that it is a non-zero uniformly bounded value for all 
orbits. We may now proceed to the proof of the theorem. 
First step: Permanence of the periodic orbits for small c 
Let Xp G [—1, 1] X [—1, 1] be, for example, the coordinate of the p— periodic 

orbit closest to zero. The sequence {x*} = |x* : p = 2, 4, 8, ...| is an element 
of a ioo Banach space (sup norm). The collection of fixed point equations 



r 



defines a C°°— mapping F{x*, c) from i^o R ^ ioo ■ Because (^/^^^) (x*) at 
c = is negative and bounded for all p, the derivative DiF of the mapping in 
the first argument is invertible. Therefore, by the implicit function theorem 
for Banach spaces, there is a c* such that for c < c* the function x*{c) : R — > 
ioo is defined, that is, there are p— periodic orbits for all periods p = 2". The 
derivative of this function is defined componentwise (in p) by 



dc \ Dx / dc 



(5) 



For the uncoupled case (c = 0) the instability factor (^/'•^-'^ (x*) for each 
mapping is the product {—2n^YY[k=i^i^) o'^^r the orbit coordinates. For 
c < c*, the orbit structure being preserved, their projections on the axis are 
continuous deformations of the c = case which will preserve the geometric 
relations of the Feigenbaum accumulation point. Hence the same products 
for the projected coordinates suffer changes of order a{c)pX^ and remain 
bounded. 

Second step: Stabilization of at least one orbit for all periods p = 2" with 

n > N{c) 

The stability of the periodic orbits is controlled by the eigenvalues of the 

Jacobian Jp = jl^*'" in the fixed point of f^Jc- '^^^ map (g) is a composition 
of two maps /i o /a 



/2 





1 — C)Xi + CX2 
CXi + (1 - C)X2 
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By the chain rule the Jacobian is 

p 



J n 



n 

fc=i 











1 -c 

c 



c 

1 - c 



with determinant 



det Jp = (1 - 2cf{-2ii,fP n xi(A:)x2(A;) 



(6) 



(7) 



k=l 



Because of the permanence of the periodic orbits, for small c, in the neighbor- 
hood of the original coordinates (those for c = 0), the product of the last two 
factors in is uniformly bounded for all p. Then for all sufficiently large 
p, I det Jp\ < 1. The question is how this overall contraction is distributed 
among the two eigenvalues of Jp. 

To discuss the nature of the eigenvalues we may use a first order approx- 
imation in c. For a periodic orbit of period p = 2" we define 

1 ifl>q i 



X, 



(0 

l,q 



(8) 



For small c consider the linear approximation to the Jacobian Jp 



(l-pc)xg 

The eigenvalues are 
A± = 1(1 -pc) (Xf^j + Xg 



.(2) 
- l,p 



(9) 

If the periodic orbit runs with the two coordinates xi and X2 synchronized 
then 

^+ = Xi,p 

A_ = (l-2pc)Xi,p 

and the orbit being unstable for c = it remains unstable for c ^ 0. However 
if the two coordinates are out of phase by | steps the radical in Eq. (Rf) is 



n ^(*) 

k=l 



x{i)x{i + 1) ■ ■ ■ x{i H 1 



i=l 
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The existence of a superstable orbit for all periods p = 2" implies that 
at ^ = /i* the product 0^=1 has an odd number of negative-valued 
coordinates. Therefore the two eigenvalues are complex conjugate and, for 
small c, the contraction implicit in (J^) is equally distributed by the two 
eigenvalues. Therefore for sufficiently large all orbits of this type with 
p > 2^ become stable periodic orbits. □ 

The conclusion should not depend on the use, in the last step, of a lin- 
ear approximation (in c) because the sign of the term under the radical is 
a consequence of the geometric nature of the orbits at the Feigenbaum ac- 
cumulation point. Then at sufficiently small c the conclusions of the linear 
analysis hold. 

The attracting periodic orbits of the coupled system being associated to 
the unstable periodic orbits of the Feigenbaum cascade, the basins of attrac- 
tion will be controlled by neighborhoods of these orbits in each coordinate. 
Therefore a checkerboard-type structure is expected for the basins of attrac- 
tion. 

Fig.l shows the structure of the basins of attraction of the orbits for 
c = 4 X 10~^. A mesh of 4000 x 4000, each point being an initial condition 
for the two units. The coupled system is allowed to evolve for 4 x 10^ time 
steps and then the sequence is analyzed and its period determined. Periods 
are detected up to pmax = 2^^. The basins, labelled by the period of the 
orbits, are displayed using the color map in Table I. The detected orbits 
have all periods from 2^ to pmax but some of the basins are so narrow that 
they can hardly be seen in the figure. 



Period 


Colour 


Period 


Colour 


2^ 


lightred 


29 


cyan 


2^ 


red 


210 


lightblue 


26 


yellow 


211 


blue 


2^ 


lightgreen 


>2i2 


brown 


2^ 


green 


others 


darkgray 



Table I 



The behavior described above holds only for very small couplings. Nu- 
merically one finds that, as the coupling strength increases, the number of 
different stable periodic orbits decreases. A similar behavior occurs for net- 
works with many units where, for large couplings, global synchronization or 
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synchronization in clusters seems to be the rule as already been observed in 
the past by many authors that have studied coupled map lattices. 

3 Feigenbaum networks with many units 
3.1 Mean- field analysis 

For the calculations below it is convenient to use as variable the net input to 
the units, yi = J2j ^ij^j- Then Eq.(P becomes, 

N 

2/,(t + l) = l-/i,^M^,,?/|(t) (10) 
i=i 

For practical purposes some restrictions have to be put on the range of 
values that the connection strengths may take. For information processing 
(pattern storage and pattern recognition) it is important to preserve, as much 
as possible, the dynamical diversity of the system. That means, for example, 
that a state with all the units synchronized is undesirable insofar as the 
effective number of degrees of freedom is drastically reduced. From 

5y,it + 1) = -2fiMt)iWu6y,it) + ^ W,,6y,{t)) (11) 

one sees that instability of the fully synchronized state implies \2fi^y{t)Wii\ > 
1. Therefore, the interesting case is when the off-diagonal connections are 
sufficiently small to insure that 

Wu > — (12) 

For large A^, provided there is no large scale synchronization effect, a 
mean-field analysis might be appropriate, at least to obtain qualitative es- 
timates on the behavior of the network. For the unit i the average value 
< 1 — Wijy]{t) > cLcts like a constant and the mean- field dynamics is 

Zi{t + l) = l- fi.,,eff z^it) (13) 
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where 



< 1 - /i* E Wiiv'^ > 



(14) 



and 

Hi^eff = fJ'^Wii < 1 - /i* ^ ^ijVj > (15) 

l-ti,eff is the effective parameter for the mean-field dynamics of unit i. From 
(|T2|) and (p!5|) it follows n^Wa > fJ'i,eff > /i*VFii(2 — /i*). The conclusion is 
that the effective mean-field dynamics always corresponds to a parameter 
value below the Feigenbaum accumulation point, therefore, one expects the 
interaction to stabilize the dynamics of each unit in one of the 2"- periodic 
orbits. On the other hand to keep the dynamics inside an interesting region 
we require fJ-i^eff > = 1-3681, the period-2 bifurcation point. With the 
estimate < y"^ >= | one obtains 

fl*Wu{l - y (1 - W,,)) > /i2 (16) 
which, together with ([T2|) , defines the interesting range of parameters for 

Except for direct numerical simulations and mean-field analysis, no other 
efficient techniques are available for the study of coupled maps with many 
units. However, as remarked by several authors |Tl| [jl2|, the mean-field is 



in general a problematic assumption. In the numerical simulations which we 
performed, to demonstrate the potential applications of Feigenbaum networks 
as signal processors, we have indeed found that the mean-field analysis holds 
only for a small range of (small) couplings. It was in this narrow mean-field 
window that the numerical experiments were carried out. 



3.2 Feigenbaum networks as signal processors 

Recent studies of biological systems suggest that complex and chaotic dy- 
namics plays an important role in biological information processing[jl3[. In 



the biological models the chaotic units are large interacting aggregates of 
neurons not the individual neurons themselves. It is therefore these aggre- 
gates that should be identified with the chaotic units in the mathematical 
models. 
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In particular the evidence from the study of the mammahan olfactory 



system 1 14] [15| |16| [17] [18] ]19] is very interesting. The researchers that 
studied this system propose a strange attractor with multiple wings, each 
one being accessed depending on the initial conditions imposed by the ex- 
ternal stimulus. However with one invariant measure associated to a unique 
attractor (no matter how many wings it possesses) we would expect the sys- 
tem to have a non- negligible probability to explore all regions, leading to 
unreliable pattern identification. It is probably better to consider that, to 
each external stimulus, corresponds a different invariant measure, a scheme 



that has recently been illustrated using Bernoulli units[|20|. Whatever the ex- 



act dynamical mechanism, schemes of this type where, from a low-intensity 
chaotic basal state, the system is excited into a different chaotic attractor, 
have a very high storage capacity due to the diversity of all possible dynamics 
and, on the other hand, display a very fast response time. The recognition 
time in the olfactory system (in the sense of the time needed to switch be- 
tween two space-coherent patterns) being of the order of magnitude of the 
response time of individual neurons, a chaos-based mechanism is much more 
likely than the paradigm of attractor neural networks [|2l]]. A recognition time 
of the order of magnitude of the cycle time is incompatible with the fixed 
point paradigm, but it is easy to understand in a chaos-based scheme. 

The Feigenbaum attractor is not chaotic, in the Lyapunov exponent sense. 
Nevertheless, as an accumulation point of period-doubling bifurcations it ac- 
cesses an infinite number of different periodic orbits and, in principle, is 
capable of processing a very large amount of information. As we have seen, 
a system of many such units, interacting through synaptic-type connections, 
is driven into periodic behavior by the coupling. The nature of the orbits 
reflects the pattern of synaptic connections and if these are obtained by a 
learning mechanism, through exposure to some external signal, the system 
might act as a signal identifier. If, in addition, the external signal is made 
to modulate some of the inputs to the individual units, mechanisms of asso- 
ciative pattern recognition would be obtained. 

Let, for example, the Wij connections be constructed from an input signal 
Xi by a correlation learning process 

^ij W-j = {Wij + r]XiXj)e-^ for i ^ j . . 

The dynamical behavior of the network, at a particular time, will reflect the 
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learning history, that is, the data regularities, in the sense that Wij is being 
structured by the patterns that occur more frequently in the data. The de- 
cay term e""^ insures that the off-diagonal terms remain small and that the 
network structure is determined by the most frequent recent patterns. Al- 
ternatively, instead of the decay term, we might use a normalization method 
and the connection structure would depend on the weighted effect of all the 
data. 

In the operating mode described above the network acts as a signal identi- 
fier. For example if the signal patterns are random, there is little correlation 
established and all the units operate near the Feigenbaum point. Alterna- 
tively the learning process may be stopped at a certain time and the network 
then used as a pattern recognizer. In this latter mode, whenever the pattern 
{xi} appears, one makes the replacement 

Wij ^ W-j = WijXiXj hi i j , . 

Therefore if Wij was 7^ but either X or Xj IS — then Wij = 0. That is, the 
correlation between node i and j disappears and the effect of this connection 
on the lowering of the periods vanishes. 

If both Xi and Xj are one, then W^j = Wij and the effect of this connection 
persists. Suppose however that for all the Wj/s different from zero either Xj 
or Xj are equal to zero. Then the correlations are totally destroyed and 
the network comes back to the uncorrelated (nonperiodic behavior). This 
case is what is called a novelty filter. Conversely, by displaying periodic 
behavior, the network recognizes the patterns that are similar to those that, 
in the learning stage, determined its connection structure. Recognition and 
association of similar patterns is then performed. 

A numerical simulation was made for a network of 100 units. During 
a learning phase a single binary pattern {xj} was presented many times to 
the network, the network connections evolving according to the correlation 
learning method (Eq.(|l7D) and a normalization prescription. 

After the learning phase, the connections Wij are considered to be frozen 
and we have tested the reaction of the network to several other patterns. 
In this recall phase, to present a pattern to the network means to make 
the replacements of Eqs.(|l^) and to let the system evolve from a random 
initial condition. As the system might be sensible to the initial conditions. 
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we choose the same initial conditions for all patterns. The results are shown 
in Fig.2. Each pattern leaves a unique signature given by the set of periods 
to which each unit converges. The periods in each unit are measured after a 
transient delay of 2 x 10^ time steps. 

In Fig.2 the first pattern that is presented to the network is the one that 
was memorized. The others are chosen in the following way: 

- the second is the complementary binary pattern to the one that was 
memorized. This pattern being non-correlated to the learned pattern, the 
network units become uncoupled and only very high periods arc seen. 

- for the remaining patterns some bits are swapped (from to 1) in the 
complementary pattern, forming new signals which are weakly correlated 
with the memorized one. The bit swapping structure is listed in Table II. 
The signature of the correlations is seen from the low periods that appear 
in some of the network units (Fig.2). The color map is the same as used in 
Sect. 2. 



pattern 


correlated bits 


memorized 


all 


1 


none 


2 


10,76 


3 


10,20,76,89 


4 


5,10,20,36,52,76,89,100 



Table II 



4 Final remarks 

For its dynamical diversity and the selective stabilization effect of the cou- 
plings, Feigenbaum networks, both with few and with many units, seem to 
be a potentially interesting system for signal processing through complex 
dynamics and to model self-organization. 

As seen in Sect. 2, the size of the basins of attraction of the sinks created 
by the coupling is controlled by the geometry of the pre-existing unstable 
periodic orbits and, as a consequence, are extremely small for large periods. 
It might therefore be useful for practical applications to be able to control the 
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dynamics in a more efficient way. This implies departures from the simple 
linear coupling scheme of Eq. (|l]) . For example we might use 



x,{t + 1) = 1 - + 5^ Wi,f{x,{t),xj{t)) {x,{t) - Xi(t))| (19) 

with 

fix, y) = e{x)9{x -y) + e{-x)e{y - x) 
or the smooth version 

fi.x,y) = ^ |l + tanh (^^x^ tanh ^^(x - ?/)^ | 

For small couplings this leads to a much larger shift to smaller values of the 
fii^eff discussed in Sect. 3. 

Alternatively we might think of using other maps, which also possess 
an infinite diversity of periodic behaviors. Consider for example a piecewise- 
linear dynamics for the units [x — > jSx + a (mod.l)). For (3 > 1 the uncoupled 
dynamics is fully chaotic. However, through interaction, it is possible to 
select and stabilize an infinite number of periodic orbits. Consider a fully 
connected network with dynamics 

x,{t + 1) = /5 I ^ WijXjit) I + a (mod. 1) (20) 



with Xi in the interval [0, 1). For a large number of weakly correlated units 
a mean-field analysis as in Sect. 3 leads to 

Xi{t + 1) = Pi,effWiiXi{t) + ai^eff (mod. 1) (21) 



where 

A,e// = m^ (22) 

13 



If /3 > 1 the individual uncoupled units have an invariant measure absolutely 
continuous with respect to Lebesgue measure. However if /?j,e// < 1 the 
dynamics of Eq.(^) has attracting periodic orbits of all periods, depending 
on the values of the parameters and (3eff ■ The point of the periodic 



orbit with the smallest coordinate is obtained from|22 

\eff 



Pi,eff) -^rain 



a. 



i,eff: 



Ppip) 



[1 - Pi,eff) 

where p is the period of the orbit and Pp{(3) is a polynomial in (3 



(24) 



p,(/3) = i+x: 

k=2 



V 



{k - 1)3 



P 



13'' 



p—k 



(25) 



where j (prime to p) is the jump number of the orbit and [n] denotes the 
integer part of n. 
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Figure captions 

Fig.l - Color coded basin of attraction periods for two units and c — 

4 X 10~^ 

Fig. 2 - Color coded periods in a network of 100 units reacting to several 
patterns 
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This figure "figl.gif" is available in "gif" format from: 



http://arXiv.org/ps/chao-dyn/9712004v2 



This figure "fig2.gif" is available in "gif" format from: 
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